Multi-path message distribution and message reassembly for large data flow using forward error correction with high-performance computing (hpc)

ABSTRACT

A reliable high-throughput data transmission may be accomplished using a multi-path message distribution and a message reassembly with a forward error correction protection. An incoming flow of data from a source is received at an input parser. The incoming flow of data is divided into a plurality of packets by the input parser. The plurality of the packets is encoded with a FEC and transmitted over a network with a plurality of transmission links The transmitted plurality of FEC encoded packets are decoded. The decoded plurality of packets is merged to an outgoing flow of data with an output multiplexor and the outgoing flow of data is sent to a destination.

CROSS-REFERENCE TO RELATED APPLICATIONS

This patent application claims the benefit of U.S. Provisional PatentApplication No. 62/900,886, filed 16 Sep. 2019. The disclosure of thepriority application is incorporated in its entirety herein byreference.

TECHNICAL FIELD

This disclosure relates to network communication, and more particularlyto multi-path message distribution and message reassembly for large datausing forward error correction with a high-performance computing.

BACKGROUND

The objective of this method is to provide a reliable high-throughputdata transmission for a user network data flow that may be accomplishedusing a plurality of transmissions paths and utilizing Forward ErrorCorrection (FEC). While a single data flow may be supported via a singletransmission path, user network data may be spread over a plurality oftransmission paths for multiple reasons. First, the user data may besent over parallel paths to widen the transmission path for higherthroughput. Second, the data may be sent in a redundant fashion, wherethe data is repeated, e.g. to replicate the data should a packet be loston one of the transmission paths. Third, on relatively balanced orsimilar latency transmission paths, data may be retransmitted if lostduring transmit on any one transmission path. The techniques previouslydescribed demonstrate prior art, to provide a reliable transmissionpath, but only if there are no high-latency paths that requireretransmission of the lost data on the high-latency path, such as asatellite transmission path.

In addition to the described techniques, another well know mechanism forrecovering lost or damaged packets is to utilize FEC, where additionalparity bits are added to the data flow to recover or reconstruct lostdata in a lossy data stream, without the need to have the dataretransmitted by the sender.

None of the previously described techniques alone are novel, and theability to apply of these techniques may be limited to providingreliable data delivery for many flows for non-real-time data.

SUMMARY

The invention herein is directed as a system and method supportingsingle or limited network user data flows, where there is a single orlimited number of high-data rate user network data flows being supportedfrom the source to the destination. In the prior art, the describedmethod works, since there is an assumption that there are many usernetwork data flows being supported and all are low rate, non-real-timedata from the source to the destination. However, the prior art cannotsupport high-data rate network flows in real-time and when one ormultiple paths are high-latency transmission links The described methodis supported by a High-Performance Computing (HPC) environment andprovides a novel approach to utilize the described invention to provideextremely high-data rate where the network data flows operate atextremely high data rates resulting in nearly “line rate” operation overall links (transmission paths) to ensure reliable transmission of datain real-time. Using the HPC to provide the additional compute powernecessary for the introduction of the FEC on each of the flows, atransmission path with adequate data integrity can be accommodated toensure that at the destination end, data can be received, re-sequenced,corrected (recreated) without the need to have data retransmitted as isrequired in the prior art. Using the advanced processing technology,these techniques may be accomplished in near real-time using ahigh-level coding language such as OpenCL or C (a high-level language)to implement the FEC functionality as a x86 based software applicationrunning on a High-Performance Computing platform. The system and methoddescribed leverages the ability to receive a single or limited number ofhigh-data rate flow(s) and the application of FEC using the heterogenouscompute environments to apply the FEC parity bits to each flow. Themethod defines the reception of multiple flows at the destination HPC toperform the combining and reconstruction of the flow(s), as well as, therecovery of any missing data at the destination network.

An additional function that may be performed by the source anddestination application would be to encrypt the user network data priorto the introduction of FEC for added security.

And additional function that may be performed by the source anddestination application would be to add dummy data at the source forobfuscation of the beginning and end of a user data traffic. The dummydata is removed at the destination, so the obfuscation data does notegress for the destination user network data flow. The dummy datainserted would also be FEC encoded and scrambled along with the userdata being passed from source to destination using the method andsystem. Additional dummy data may add additional data for providingadditional FEC data to other flows over the plurality of flows.

A heterogenous architecture is comprised of at least one or moreprocessor cores to optimize performance and energy efficiency byappropriating computations matched to the type of processor available.These cores can be, but are not limited to, a general-purpose CPU,Graphics Processing Units (GPU), or Field Programmable Gate Arrays(FPGA's).

It is the objective of this invention to provide a method for providingextremely reliable communications for real-time data, at extremely highdata rates, over multiple transmission paths, with the optionality ofscrambling and obfuscation of the transport data while utilizing HPCtype applications leveraging at least one hardware-based accelerator.

These objectives are accomplished by the various aspects of theinvention that uses multiple factors to create a high-speed, reliable,and redundant transmission path while not depending on retransmission ofdata on any transmission path. The present disclosure covers the stepsrequired to accomplish the transmission of user data while using ahigh-performance computing (HPC) application.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates the prior art of a particular implementation of usinga plurality of links;

FIG. 2 illustrates the prior art of a particular implementation of usinga plurality of links through a Route Deviation devices;

FIG.3 illustrates an issue with the prior art of a particularimplementation of using a plurality of links through the Route Deviationdevices;

FIG. 4 illustrates the prior art of a particular implementation of usinga plurality of links with low and high-latency through the RouteDeviation devices;

FIG. 5 illustrates an issue with the prior art of a particularimplementation of using a plurality of links with low and high-latencythe Route Deviation devices;

FIG. 6 illustrates the prior art of particular implementation of using aplurality of links with low high-latency and a satellite link;

FIG. 7 illustrates an issue with the prior art of particularimplementation of using a plurality of links with low high-latency and asatellite link;

FIG. 8 illustrates a particular implementation of using a plurality oflinks using a Route Deviation devices in accordance with animplementation of the disclosure,

FIG. 9 illustrates an alternate embodiment with data scrambled prior totransmission and the addition of FEC in accordance with animplementation of the disclosure.

FIG. 10 illustrates an alternate embodiment with dummy data added priorto transmission, FEC and scrambling in accordance with an implementationof the disclosure.

FIG. 11 illustrates data flow paths of a source in accordance with animplementation of the disclosure.

FIG. 12 illustrates data flow paths of a destination in accordance withan implementation of the disclosure.

At the outset, it should be appreciated that like drawing numbers ondifferent drawing views identify identical structural elements of theinvention. It also should be appreciated that figure proportions andangles are not always to scale in order to clearly portray theattributes of the present invention.

DETAILED DESCRIPTION

While the present invention is described with respect to what ispresently considered to be the preferred embodiments, it is understoodthat the invention is not limited to the disclosed embodiments. Thepresent invention is intended to cover various modifications andequivalent arrangements included within the spirit and scope of theappended claims.

Furthermore, it is understood that this invention is not limited to theparticular methodology, materials and modifications described and assuch may, of course, vary. It is also understood that the terminologyused herein is for the purpose of describing particular aspects only andis not intended to limit the scope of the present invention, which islimited only by the appended claims.

Unless defined otherwise, all technical and scientific terms used hereinhave the same meaning as commonly understood to one of ordinary skill inthe art to which this invention belongs. It should be appreciated thatthe term “substantially” is synonymous with terms such as “nearly”,“very nearly”, “about”, “approximately”, “around”, “bordering on”,“close to”, “essentially”, “in the neighborhood of”, “in the vicinityof”, etc., and such terms may be used interchangeably as appearing inthe specification and claims. It should be appreciated that the term“proximate” is synonymous with terms such as “nearby”, “close”,“adjacent”, “neighboring”, “immediate”, “adjoining”, etc., and suchterms may be used interchangeably as appearing in the specification andclaims. Although any methods, devices or materials similar or equivalentto those described herein can be used in the practice or testing of theinvention, the preferred methods, devices, and materials are nowdescribed.

This disclosure, its aspects and implementations, are not limited to thespecific processing techniques, components, word/bit widths, or methodsdisclosed herein. Many additional components and processes known in theart consistent with the modification, manipulation and encryption anddecryption of a file or files by a computer program are in use withparticular implementations from this disclosure. Accordingly, forexample, although particular implementations are disclosed, suchimplementations and implementing components may comprise any components,models, versions, quantities, and/or the like as is known in the art forsuch systems and implementing components, consistent with the intendedoperation.

Particular implementations of a method and approach within an HPCarchitecture of how to provide reliable, high-performance and pathdiverse transmission is described. However, as will be clear to those ofordinary skill in the art from this disclosure, the principles andaspects disclosed herein may readily be applied to a multitude oftransmission paths regardless of the latency and reliability of a giventransmission path applications without undue experimentation.

FIG. 1 illustrates the prior art of a particular implementation of usinga plurality of links while using re-transmission of data to recover anylost data. The ability to utilize the plurality of links is configuredby Route Deviation Controller (RDC) and the selection of the routes ismade possible by the Route Deviation Device (RDD) that is placed alongthe route of the diverse path. The prior art, as shown, performs in anacceptable manner when the user network data is comprised of many usernetwork sessions over plurality of transmission flows, and all data istransported over low-latency, low loss links In many cases the usernetwork data is non real-time and is transported using aconnection-oriented Transmission Control Protocol (TCP). In the priorart, the multitude of flows over low-latency, low loss links withretransmissions being performed over the links operate with minimalissues.

FIG. 2 illustrates the prior art of a particular implementation of usinga plurality of links where multiple flows are spread over multiplelow-latency links through the Route Deviation devices

FIG. 3 illustrates the prior art of a particular implementation of usinga plurality of links where multiple flows are spread over multiplelow-latency links, through the Route Deviation devices, where lost datais retransmitted in the event data is lost on a given flow.

FIG. 4 illustrates the prior art of a particular implementation of usinga plurality of links where the links, through the Route Deviationdevices, may be spread over low and high-latency links FIG. 4demonstrates no loss of data.

FIG. 5 illustrates the prior art of a particular implementation of usinga plurality of links where the links, through the Route DeviationDevices, may be spread over low and high-latency links where lost datais being retransmitted in the event data is lost on a given flow butonly a small or no delay due to the retransmission is realized.

FIG. 6 illustrates the prior art when carrying a single or limitednumber of user network data flows, through the Route Deviation Deviceswhere one of the links is a satellite link, and when there is no dataloss on a high-latency (satellite) link.

FIG. 7 illustrates the issue with the prior art when carrying a singleor limited number of high-speed user network data flows, through theRoute Deviation Devices where one of the links is a satellite link, andwhen data loss occurs on a high-latency (satellite) link The lost dataresults in the entire transmission path stopping, also known asstalling, and no data will flow to the end point until re-transmissionhas taken place. Even if a retransmission could be accomplished, thedata rate is high enough that a stall is still realized. Therefore, theprior art becomes unusable.

FIG. 8 illustrates the novelty of the invention where the flows areexactly as show in FIG. 6 and FIG. 7, using a Route DeviationController, but instead of relying on the fact that there are many usernetwork data flows along with retransmission, the described inventionmay support both many low data-rate user network flows as well as one ora limited user data flow with FEC to overcome the stalling. In FIG. 8packet A2 is lost or corrupted over a high-latency satellite linkInstead of retransmission of packet A2, A2 is recovered by FEC,resulting no delay or a missing packet. To accomplish this, aHeterogenous (High-Performance Computing) Route Deviation Device (HRDD)with adequate compute power is required. The described invention bringsto bear the fact that the described method is supported with the aid ofthe HPC technology via a high-level user application. The novelty of theinvention is possible only with the HRDD's combined computing power ofthe CPU and hardware assisted processor.

FIG. 9 illustrates an alternate embodiment where the user network datamay be scrambled prior to transmission and the addition of FEC inaccordance of an implementation of the disclosure. The source adds thescrambling and the destination removes the scrambling prior to egress asa user network data flow. The described invention brings to bear thefact that the described method is supported with the aid of the HPCtechnology via a high-level user application. The novelty of theinvention is possible only with the HRDD's combined computing power ofthe CPU and hardware assisted processor.

FIG. 10 illustrates an alternate embodiment where the user network datamay have dummy data added prior to transmission, as well as, theaddition of FEC and/or scrambling. The source adds the dummy packets andthe destination removes the dummy prior to egress as a user network dataflow. The described invention brings to bear the fact that the describedmethod is supported with the aid of the HPC technology via a high-leveluser application. The novelty of the invention is possible only with theHRDD's combined computing power of the CPU and hardware assistedprocessor.

FIG. 11 illustrates an ingress of user network data flows into thedescribed invention and creation of the queues (flows) for each path.The combined flows demonstrate that dummy and scrambler data may beadded and then FEC passed over each of the flows in full or in part tothe transmission path flows. In an implementation, an incoming flow ofdata from a source is received at an input parser. The incoming flowdata is a single stream of data and is divided into a plurality ofpackets with a plurality of data flow paths. The plurality of packets ispassed to a master FEC, which encodes the plurality of packets andgenerate a FEC encoded plurality of packets. Then, the FEC encodedplurality of packets are transmitted to a network with a plurality oftransmission links

In another implementation, dummy data may appended to the plurality ofthe packets or the plurality of the packets may be scrambled prior tothe FEC encoding. In another implementation, both dummy data andscramble may be applied to the plurality of the packets prior to the FECencoding.

FIG. 12 illustrates an ingress of the transmission path flows where theFEC is decoded on a single or multiple flows to receive and recreateeach of the flows and then optionally unscrambled and/or optionallydummy packets removed, and then placed in the input queue forresequencing and egressed as the reconstructed user network data flow.The FEC encoded plurality of packets in FIG. 11 is transmitted over anetwork via a plurality of the transmission links and is received at amaster FEC, which decodes the encoded plurality of packets into aplurality of packets. The plurality of packets is, then, passed to anoutput combiner and is combined to an outgoing flow of data to adestination.

In an implementation, the plurality of packet may be de-scrambled and/ordummy data may be removed from the plurality of packets.

In the preferred embodiment, the described invention utilizes ahigh-performance computing HPC PC or server with at least one CPU and ahardware acceleration device and utilizing a high-level coding languageplatform to perform the method as an application. The HPC receives oneor more user network data flows that is further broken into a pluralityof flows, where each flow must pass through an a priori HPC-basedHeterogenous Route Deviation Device (HRDD) and where each data flow isan independent flow from the source towards the destination. For eachpath available between the source and destination, a separate flow iscreated. The data flow is established as flow that is assumed to belossless with a configured estimate or “assumed” data rate that may beachievable over the transmission path. Each of the data flows areestablished prior to transmission. Upon runtime, each flow is thenmonitored with return data from the remote end to determine theavailable data rate that is received. During run time, the received datarate on each flow is then monitored and data rates are adjusted acrosseach of the flows to ensure no one data flow is being overrun. In thepreferred embodiment, each flow has FEC applied on each path that allowsup to an entire flow to be lost before lost data becomes unrecoverableat the destination. The FEC is applied to ensure that data may berecovered at the destination end and metrics are then provided from thereceiving end to notify the source of the performance of each link, e.g.how much traffic is flowing through the link and if the particular linkis losing data or is underutilized. The method allows for dynamicadjustment of the flows to ebb and flow the assignment of data in theevent a given link is performing poorly or being underutilized. Unlikethe prior art, no data is required to be duplicated or retransmitted,but instead FEC data is used to recover lost, missing, or damaged data;however, only the performance of the Heterogeneous Route DeviationDevice based on the HPC can achieve the real-time performance ofapplying FEC at line rates. Both the source and destination monitoringdevices performing the operation in the preferred embodiment is achievedusing the HPC as a heterogeneous application process on both ends of thelink

In an alternate embodiment, the FEC may be reduced as the networkperformance increases (for example, lower loss/latency) but can orshould never be completely disabled.

The use of FEC accelerated by the HPC in the preferred embodimentpreserves the real-time nature of the user data network.

The novelty of the invention is there is no requirement of the usernetwork traffic to account for lost data, so that both TransmissionControl Protocol (TCP) a connection-oriented protocol as well as a UserDatagram Protocol (UDP) a connectionless protocol can be equallysupported with equal end-to-end performance.

In an alternate embodiment, the data passed over each flow may bescrambled before or after the FEC by the source and passed over thetransmission network and the scrambling removed by the destination. Thescrambling may be performed by a fixed scrambling scheme with a priorinotification of a scrambling polynomial or via a dynamic key rollingscheme that is time, control channel triggered, or reset by machine orhuman intervention. Through the use of the HPC, the real-time nature ofthe user network data flow maintained by the FEC and scrambling process.

In an alternate embodiment, the data passed over each flow may havedummy data (non-user network data) before or after the FEC andscrambling by the source and passed over the transmission network. Thedummy data is removed by the destination. The addition of the dummy datamay be performed by adding fixed, time varying, or random sized datapackets via a number of packets, time, control channel triggered, orconfigured by machine or human intervention. Through the use of the HPC,the real-time nature of the user network data flow is not interrupted bythe dummy data process.

A back flow (return channel) may be provided from the receiving end toprovide back channel information to instruct the sender as to how wellthe links are performing in part (each link), in whole (all links), thedata rates on each link and FEC may be adjusted to optimize the linksfor optimal bandwidth utilization.

The following are particular implementations with the HPC applicationmulti-transmission path scheme, and the use of these methods areprovided as non-limiting examples.

-   -   1. A user desires to send user data from a source location to a        remote location using a single user data flow of high-speed        real-time waveform data that may not be delayed or experience        any packet loss. In this non-limiting example, the Route        Deviation Controller (RDC) is utilized to establish multiple        paths through a plurality of links each containing a        Heterogenous Route Deviation Device (HRDD) where there is one        satellite transmission path with a latency of 0.325 seconds, two        optical connections with a latency of 0.025 second and a        microwave connection with a latency of 0.05 seconds. Using the        described method, the single incoming flow is then separated        into four transmission links, FEC is applied across all four        links, and a packet is lost on the satellite link Using the        described method with the HRDD, a lost packet on the satellite        link is corrected by the reception of the packets received prior        to and after the lost packet, as well as the FEC on the other        links carrying data on the other transmission paths.    -   2. A user desires to send user data from a source location to a        remote location using a single user data flow of high-speed        real-time waveform data that cannot tolerate excessive delay or        any packet loss. In this non-limiting example, the Route        Deviation Controller (RDC) is utilized to establish multiple        paths through many links each containing a Heterogenous Route        Deviation Device (HRDD) where there is a one satellite        transmission path with a latency of 0.325 seconds, two optical        connections with a latency of 0.025 second and a microwave        connection with a latency of 0.05 seconds. Using the described        method, the single incoming flow is then separated into four        transmission links, FEC is applied across all four links, and a        packet is lost on the satellite link Using the described method,        the microwave transmission link is lost resulting in one quarter        of all the data being lost on the microwave link Using the FEC        spread over the remaining three links, on the other transmission        paths the entire data is reconstructed without having to be        retransmitted.    -   3. A user desires to send user data from a source location to a        remote location using a single user data flow of high-speed        real-time waveform data that may not be delayed or experience        any packet loss. In this non-limiting example, the Route        Deviation Controller (RDC) is utilized to establish multiple        paths through many links each containing a Heterogenous Route        Deviation Device (HRDD) where there are four satellite        transmission paths, each with a latency of 0.325 seconds. Using        the described method, the single incoming flow is then separated        into four transmission links, FEC is applied across all four        links, and a packet is lost on the satellite link Using the        described method, a lost packet on the satellite link is        corrected by the reception of the packets received prior to and        after the lost packet, as well as, the FEC on the other links        carrying data on the other transmission paths.    -   4. A user desires to send user data from a source location to a        destination location using a single user data flow of high-speed        real-time data that cannot tolerate excessive delay or any        packet loss. In this non-limiting example, the Route Deviation        Controller (RDC) is utilized to establish multiple paths through        many links each containing a Heterogenous Route Deviation Device        (HRDD) where there are four satellite transmission paths with a        latency of 0.325 seconds. Using the described method, the single        incoming flow is then separated into four transmission links,        FEC and scrambling of all data is applied across all four links,        and a packet is lost on the satellite link Using the described        method, a lost packet on the satellite link is corrected by the        reception of the packets received prior to and after the lost        packet, as well as, the FEC on the other links carrying data on        the other transmission paths. The scrambling of all data would        be removed prior to egress to the user network data. As a result        of scrambling, an “observer in the middle” of any one flow would        see data that the data is unusable due to being scrambled.    -   5. A user desires to send user data from a source location to a        destination location using a single user data flow of high-speed        real-time data that may not be delayed or experience any packet        loss. In this non-limiting example, the Route Deviation        Controller (RDC) is utilized to establish multiple paths through        many links each containing a Heterogenous Route Deviation Device        (HRDD) where there are four satellite transmission paths with a        latency of 0.325 seconds. Using the described method, the single        incoming flow is then separated into four transmission links,        FEC and scrambling of all data is applied on across all four        links and dummy data is introduced, and a packet is lost on the        satellite link. Using the described method, a lost packet on the        satellite link is corrected by the reception of the packets        received prior to and after the lost packet, as well as, the FEC        on the other links carrying data on the other transmission        paths. The scrambling of all data would be removed, and dummy        data is removed prior to egress to the user network data. As a        result of scrambling, an “observer in the middle” of any one        flow would see data that is unusable due to being scrambled. The        dummy data insertion prevents traffic analysis by the “observer        in the middle” to determine the start and stop of actual user        data.    -   6. A user desires to send user data from a source location to a        destination location using a single user data flow of high-speed        real-time data that may not be delayed or experience any packet        loss. In this non-limiting example, the Route Deviation        Controller (RDC) is utilized to establish multiple paths through        many links each containing a Heterogenous Route Deviation Device        (HRDD) where there are four satellite transmission paths with a        latency of 0.325 seconds. Using the described method, the single        incoming flow is then separated into four transmission links,        FEC and scrambling of all data is applied on across all four        links and dummy data is introduced, and a packet is lost on the        satellite link Using the described method, a lost packet on the        satellite link is corrected by the reception of the packets        received prior to and after the lost packet, as well as, the FEC        on the other links carrying data on the other transmission        paths. The scrambling of all data would be removed, and dummy        data is removed prior to egress to the user network data. During        the operation of the transmission of data, the receiving end        (implementing the receiving method) provides feedback to the        sender end (implementing the sending method) to increase the        bandwidth on the non-satellite link as well as increase the        level of FEC on the satellite link due to high-packet errors.

1. A high-performance computer (HPC) implemented method for a multi-pathdata flow with a forward error correction (FEC) protection, the methodcomprising the steps of: receiving an incoming flow of data at an inputparser, wherein the incoming flow of data is a single stream of datasent from a source; dividing the incoming flow of data into a firstplurality of packets via the input parser; passing the first pluralityof packets to a first master FEC to generate a plurality of FEC encodedpackets; transmitting the plurality of FEC encoded packets to a secondmaster FEC via a network with a plurality of transmission links;receiving the plurality of FEC encoded packets at the second master FEC,wherein the second master FEC decodes the plurality of FEC encodedpackets and generates a second plurality of packets; and passing thesecond plurality of packets to an output combiner, wherein the outputcombiner merges the second plurality of packets into an outgoing flow ofdata in a correct sequence, and wherein the outgoing flow of data isreceived at a destination.
 2. The HPC implemented method of claim 1,further comprising: appending dummy data to the first plurality of thepackets; and removing the dummy data from the second plurality of thepackets.
 3. The HPC implemented method of claim 1, further comprising:scrambling the first plurality of the packets; and de-scrambling thesecond plurality of the packets.
 4. The HPC implemented method of claim2, further comprising: scrambling the first plurality of the packets;and de-scrambling the second plurality of the packets.
 5. The HPCimplemented method of claim 1, wherein the network comprises at leastone of a low latency transmission link or a high latency transmissionlink
 6. The HPC implemented method of claim 1, wherein each transmissionlink of the plurality of transmission links is operatively coupled to aheterogenous deviation device.
 7. The HPC implemented method of claim 3,wherein scrambling is performed via a fixed scrambling scheme with apriori notification of a scrambling polynomial or via a dynamic keyrolling scheme.
 8. The HPC implemented method of claim 1, wherein alevel of FEC encoding is reduced in response to an increase of thenetwork performance.
 9. A system for providing a multi-path data flowwith forward error correction (FEC) protection, the system comprising: aroute deviation controller (RDC); a plurality of heterogenous routedeviation devices (HRDD), wherein each HRDD is implemented via a highperformance computer; a network comprising a plurality of transmissionlinks; and a high level coding language platform running on the highperformance computer, wherein the high level coding language platform isconfigured to perform: encoding a first plurality of packets to aplurality of FEC encoded packets; transmitting the plurality of FECencoded packets; and decoding the plurality of FEC packets to a secondplurality of packets.
 10. The system of the claim 9, wherein the highlevel coding language platform is further configure to perform appendingdummy data to the first plurality of the packets and removing the dummydata from the second plurality of the packets.
 11. The system of theclaim 9, wherein the high level coding language platform is furtherconfigure to perform scrambling the first plurality of the packets andde-scrambling the second plurality of the packets.
 12. The system of theclaim 10, wherein the high level coding language platform is furtherconfigure to perform scrambling the first plurality of the packets andde-scrambling the second plurality of the packets.
 13. The system of theclaim 9, wherein the high performance computer comprises at least oneprocessor and a hardware acceleration device.
 14. The system of theclaim 9, wherein the each transmission link of the plurality oftransmission links is operatively coupled to each HRDD of the pluralityof HRDDs.
 15. The system of the claim 13, wherein the processorcomprises at least one or more cores, and wherein the cores comprise atleast one of a general purpose central processing unit, a graphicprocessing unit, or a field programmable gate arrays.
 16. Anon-transitory computer readable storage medium storing instructionsthat when executed by a processing device, cause the processing deviceto: receive an incoming flow of data at an input parser, wherein theincoming flow of data is a single stream of data sent via a source;divide the incoming flow of data into a first plurality of packets viathe input parser; pass the first plurality of packets to a first masterFEC to generate a plurality of FEC encoded packets; transmit theplurality of FEC encoded packets to a second master FEC via a networkwith a plurality of transmission links; receive the plurality of FECencoded packets at the second master FEC, wherein the second master FECdecodes the plurality of FEC encoded packets and generates a secondplurality of packets; and pass the second plurality of packets to anoutput combiner, wherein the output combiner merges the second pluralityof packets into an outgoing flow of data in a correct sequence, andwherein the outgoing flow of data is received at a destination.
 17. Thenon-transitory computer-readable storage medium of claim 16, comprisingfurther instructions that when executed by the processing device, causethe processing device to append dummy data to the first plurality ofpackets and remove dummy data from the second plurality of packets. 18.The non-transitory computer-readable storage medium of claim 16,comprising further instructions that when executed by the processingdevice, cause the processing device scramble the first plurality of thepackets and de-scramble the second plurality of the packets.
 19. Thenon-transitory computer-readable storage medium of claim 17, comprisingfurther instructions that when executed by the processing device, causethe processing device to scramble the first plurality of the packets andde-scramble the second plurality of the packets.
 20. The non-transitorycomputer-readable storage medium of claim 16, wherein the networkcomprises at least one of a low-latency transmission link or ahigh-latency transmission link